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Abstract 

We consider the problem of packet scheduling in single-hop queueing networks, and analyze 
the impact of heavy-tailed traffic on the performance of Max- Weight scheduling. As a perfor- 
mance metric we use the delay stability of traffic flows: a traffic flow is delay stable if its expected 
steady-state delay is finite, and delay unstable otherwise. First, we show that a heavy-tailed 
traffic flow is delay unstable under any scheduling policy. Then, we focus on the celebrated 
Max- Weight scheduling policy, and show that a light-tailed flow that conflicts with a heavy- 
tailed flow is also delay unstable. This is true irrespective of the rate or the tail distribution 
of the light-tailed flow, or other scheduling constraints in the network. Surprisingly, we show 
that a light-tailed flow can be delay unstable, even when it does not conflict with heavy-tailed 
traffic. Furthermore, delay stability in this case may depend on the rate of the light-tailed flow. 
Finally, we turn our attention to the class of Max-Weight-a scheduling policies; we show that 
if the a-parameters are chosen suitably, then the sum of the a-moments of the steady-state 
queue lengths is finite. We provide an explicit upper bound for the latter quantity, from which 
we derive results related to the delay stability of traffic flows, and the scaling of moments of 
steady-state queue lengths with traffic intensity. 
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1 Introduction 



We study the impact of heavy-tailed traffic on the performance of scheduling policies in single- 
hop queueing networks. Single-hop network models have been used extensively to capture the 
dynamics and scheduling decisions in real- world communication networks, such as wireless uplinks 
and downlinks, switches, wireless ad hoc networks, sensor networks, and call centers. In all these 
systems, one cannot serve all queues simultaneously, e.g., due to wireless interference constraints, 
giving rise to a scheduling problem. Clearly, the overall performance of the network depends 
critically on the scheduling policy applied. 

The focus of this paper is on a well-studied class of scheduling policies, commonly refered to 
as Max- Weight policies. This class of policies was introduced in the seminal work of Tassiulas and 



Ephremides 24 , and since then numerous studies have analyzed the performance of such policies 



in different settings, e.g., see |1||9], and the references therein. A remarkable property of Max- 
Weight policies is their throughput optimality, i.e., their ability to stabilize a queueing network 
whenever this is possible, without any information on the arriving traffic. Moreover, it has been 
shown that policies from this class achieve low, or even optimal, average delay for specific network 
topologies, when the arriving traffic is light-tailed [8| |l6[[20||23[|25| . R However, the performance of 
Max- Weight scheduling in the presence of heavy-tailed traffic is not well understood. 

We are motivated to study networks with heavy-tailed traffic by significant evidence that traffic 
in real-world communication networks exhibits strong correlations and statistical similarity over 
different time scales. This observation was first made by Leland et al. |13| through analysis of 
Ethernet traffic traces. Subsequent empirical studies have documented this phenomenon in other 
networks, while accompanying theoretical studies have associated it with arrival processes that have 
heavy tails; see [17] for an overview. The impact of heavy tails has been analyzed extensively in 
the context of single or multi-server queues; see the survey papers [2j[4], and the references therein. 
However, the related work is rather limited in the context of queueing networks, e.g., see the paper 
by Borst et al. |3|, which studies the "Generalized Processor Sharing" policy. 

1 On the other hand, when Max- Weight scheduling is combined with Back-Pressure routing in the context of 
multi-hop networks, there is evidence that delay performance can be poor, e.g., see the discussion in 
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This paper aims to fill a gap in the literature, by analyzing the impact of heavy-tailed traffic 
on the performance of Max- Weight scheduling in single-hop queueing networks. In particular, we 
study the delay stability of traffic flows: a traffic flow is delay stable if its expected steady-state 
delay is finite, and delay unstable otherwise. Our previous work [15] gives some preliminary results 
in this direction, in a simple system with two parallel queues and a single server. The main 
contributions of this paper include: i) in a single-hop queueing network under the Max- Weight 
scheduling policy, we show that any light-tailed flow that conflicts with a heavy-tailed flow is delay 
unstable; ii) surprisingly, we also show that for certain admissible arrival rates, a light-tailed flow 
can be delay unstable even if it does not conflict with heavy-tailed traffic; hi) we analyze the Max- 
Weight-a scheduling policy, and show that if the a-parameters are chosen suitably, then the sum 
of the a-moments of the steady-state queue lengths is finite. We use this result to prove that by 
proper choice of the a-parameters, all light-tailed flows are delay stable. Moreover, we show that 
Max-Weight-a achieves the optimal scaling of higher moments of steady-state queue lengths with 
traffic intensity. 

The rest of the paper is organized as follows. Section 2 contains a detailed presentation of 
the model that we analyze, namely, a single-hop queueing network. It also defines formally the 
notions of heavy-tailed and light-tailed traffic, and of delay stability. In Section 3 we motivate the 
subsequent development by presenting, informally and through simple examples, the main results 
of the paper. In Section 4 we analyze the performance of the celebrated Max- Weight scheduling 
policy. Our general results are accompanied by examples, which illustrate their implications in 
practical network settings. Section 5 contains the analysis of the parameterized Max-Weight-a 
scheduling policy, and the performance that it achieves in terms of delay stability. This section also 
includes results about the scaling of moments of steady-state queue lengths with the traffic intensity 
and the size of the network, accompanied by several examples. We conclude with a discussion of 
our findings and future research directions in Section 6. The appendices contain some background 
material and most of the proofs of our results. 
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2 Model and Problem Formulation 



We start with a detailed presentation of the queueing model considered in this paper, together with 
some necessary definitions and notation. 

We denote by Z + , and N the sets of nonnegative reals, nonnegative integers, and positive 
integers, respectively. The cartesian products of M copies of and Z + are denoted by and 
Z+ , respectively. 

We assume that time is slotted and that arrivals occur at the end of each time slot. The 
topology of the network is captured by a directed graph G = (J\f,£), where N is the set of nodes 
and £ is the set of (directed) edges. Our model involves single-hop traffic flows: data arrives at the 
source node of an edge, for transmission to the node at the other end of the edge, where it exits 
the network. More formally, let F G N be the number of traffic flows of the network. A traffic 
flow / G {1, . . . , F} consists of a discrete time stochastic arrival process {Af(t)\ t G Z + }, a source 
node s(f), and a destination node d(f), with s(f),d(f) G J\f, and (s(f),d(f)) G £. We assume 
that each arrival process {Af(t); t G Z+} takes values in Z+, and is independent and identically 
distributed (IID) over time. Furthermore, the arrival processes associated with different traffic 
flows are mutually independent. We denote by A/ = i£L4y(0)] > the rate of traffic flow /, and by 
A = (A/; / = 1, . . . , F) the vector of the rates of all traffic flows. 

Definition 1: (Heavy Tails) A traffic flow / is heavy-tailed if i£L4^(0)] = oo, and light-tailed 
otherwise. 

The traffic of flow / is buffered in a dedicated queue at node s(f) (queue /, henceforth.) Our 
modeling assumptions imply that the set of traffic flows can be identified with the set of edges and 
the set of queues of the network. The service discipline within each queue is assumed to be "First 
Come, First Served." The stochastic process {Qf(t); t G Z + } captures the evolution of the length 
of queue /. Since our motivation comes from communication networks, Af(t) will be interpreted 
as the number of packets that queue / receives at the end of time slot t, and Qfit) as the total 
number of packets in queue / at the beginning of time slot t. The arrivals and the lengths of 
the various queues at time slot t are captured by the vectors A(t) = (Af(t); f = 1,...,F) and 



4 



Q(t) = (Q f (t); f = 1, . . . , F), respectively. 

In the context of a communication network, a batch of packets arriving to a queue at any given 
time slot can be viewed as a single entity, e.g., as a file that needs to be transmitted. We define the 
end-to-end delay of a file of flow / to be the number of time slots that the file spends in the 
network, starting from the time slot right after it arrives at s(f), until the time slot that its last 
packet reaches d(f). For k G N, we denote by Df(k) the end-to-end delay of the k th file of queue 
/. The vector D{k) = (Df(k); f = 1, . . . , F) captures the end-to-end delay of the k th files of the 
different traffic flows. 

In general, not all edges can be activated simultaneously, e.g., due to interference in wireless 
networks, or matching constraints in a switch. Consequently, not all traffic flows can be served 
simultaneously. A set of traffic flows that can be served simultaneously is called a feasible sched- 
ule. We denote by S the set of all feasible schedules, which is assumed to be an arbitrary subset 
of the powerset of { 1 , . . . , F} . For simplicity, we assume that all attempted transmissions of data 
are successful, that all packets have the same size, and that the transmission rate along any edge 
is equal to one packet per time slot. We denote by Sf(t) G {0, 1} the number of packets that are 
scheduled for transmission from queue / at time slot t. Note that this is not necessarily equal to 
the number of packets that are transmitted because the queue may be empty. 

Let us now define formally the notion of a scheduling policy. The past history and present 
state of the system at time slot t G N is captured by the vector 

H(t) = (Q(0), A(0), ...,Q(t- 1), A(t - 1), Q(t)). 

At time slot 0, we have H(0) = (Q(0)). A (causal) scheduling policy is a sequence ir = (/j>Q,fii, . . .) 
of functions fit : H(t) — >■ S, t G Z + , used to determine scheduling decisions, according to S(t) = 

Mm))- 

Using the notation above, the dynamics of queue / take the form: 

Qf(t + 1) = Qf(t) + Mt) - s f (t) ■ i{Q /(t) >o}, 
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for all t G Z + , where l{Q f (t)>o} denotes the indicator function of the event {Qf(t) > 0}. The vector 
of initial queue lengths Q(0) is assumed to be an arbitrary element of Z+. 

We restrict our attention to scheduling policies that are regenerative, i.e., policies under 
which the network starts afresh probabilistically in certain time slots. More precisely, under a 
regenerative policy there exists a sequence of stopping times {r„; n G Z + } with the folowing 
properties, i) The sequence {r n+ \ — r n ; n G Z + } is IID. ii) Let X(t) = (Q(t), A(t), S(t)), and 
consider the processes that describe the "cycles" of the network, namely, Cq = {X(t); < t < To}, 
and C n = {X(r n _i + t); < t < r n — r n _i}, n £ N; then, {C ra ; n G N} is an IID sequence, 
independent of Co. in) The (lattice) distribution of the cycle lengths, r n+ i — r n , has span equal to 
one and finite expectation. 

Properties (i) and (ii) imply that the queueing network evolves like a (possibly delayed) regen- 
erative process. Property (iii) states that this process is aperiodic and positive recurrent, which 
will be crucial for the stability of the network. The following definition gives the precise notion of 
stability that we use in this paper. 

Definition 2: (Stability) The single-hop queueing network described above is stable under 
a specific scheduling policy, if the vector-valued sequences {Q(t); t G Z + } and {D(k); k G N} 
converge in distribution, and their limiting distributions do not depend on the initial queue lengths 
Q(0). 

Notice that our definition of stability is slightly different than the commonly used definition 
(positive recurrence of the Markov chain of queue lengths), since it includes the convergence of the 
sequence of file delays {D(k); k G N}. The reason is that in this paper we study properties of 
the limiting distribution of {D(k); k G N} and, naturally, we need to ensure that this limiting 
distribution exists. 

Under a stabilizing scheduling policy, we denote by Q = (Q/; / = 1, . . . , F) and D = (Df, f = 
1,...,F) the limiting distributions of {Q(t); t G Z + } and {D(k); k G N}, respectively. The 
dependence of these limiting distributions on the scheduling policy has been suppressed from the 
notation, but will be clear from the context. We refer to Qf as the steady-state length of queue 
/. Similarly, we refer to Dj as the steady-state delay of a file of traffic flow /. We note that 
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under a regenerative policy (if one exists), the queueing network is guaranteed to be stable. This is 
because the sequences of queue lengths and file delays are (possibly delayed) aperiodic and positive 
recurrent regenerative processes, and, hence, converge in distribution; see |22| . 

The stability of the queueing network depends on the rates of the various traffic flows relative 
to the transmission rates of the edges and the scheduling constraints. This relation is captured by 
the stability region of the network. 

Definition 3: (Stability Region) 24] The stability region of the single- hop queueing network 
described above, denoted by A, is the set of rate vectors: 

In other words, a rate vector A belongs to A if there exists a convex combination of feasible 
schedules that covers the rates of all traffic flows. If a rate vector is in the stability region of 
the network, then the traffic corresponding to this vector is called admissible, and there exists a 
scheduling policy under which the network is stable. 

Definition 4: (Traffic Intensity) The traffic intensity of a rate vector A G A is a real number 
in [0,1) defined as: 

p(A) = inf{^C, | \ <^2(s-s, ( S G» + , VsGS}. 

Clearly, arriving traffic with rate vector A is admissible if and only if p(A) < 1. Throughout 
this paper we assume that the traffic is admissible. 

Let us now define the property that we use to evaluate the performance of scheduling policies, 
namely, the delay stability of a traffic flow. 

Definition 5: (Delay Stability) A traffic flow / is delay stable under a specific scheduling 
policy if the queueing network is stable under that policy and E[Df] < oo; otherwise, the traffic 
flow / is delay unstable. 



{a G ^ 
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The following lemma relates the steady-state quantities E[Qf] and E[Df], and will help us 
prove delay stability results. 

Lemma 1: Consider the single- hop queueing network described above under a regenerative 
scheduling policy. Then, 

E[Q f ] < oo E[D f ] < oo, V/ G {1, . . . , F}. 

Proof, see Appendix 1.1. □ 

Theorem 1: (Delay Instability of Heavy Tails) Consider the single- hop queueing network 
described above under a regenerative scheduling policy. Every heavy-tailed traffic flow is delay 
unstable. 

Proof. (Sketch) The result follows easily from the Pollaczek-Khinchine formula for the expected 
delay in a M/G/l queue, and a stochastic comparison argument. The main idea is that in a heavy- 
tailed traffic flow, the probability that a very big file arrives to the respective queue is relatively 
high. Combined with the "First Come, First Served" discipline within the queue, this implies that 
a large number of files, arriving after the big one, experience very large delays. This is true even if 
the queue gets served whenever it is nonempty, namely, if the queue is given preemptive priority. 
Consequently, under any scheduling policy, there is relatively high probability that a large number 
of files experiences very large delays. This then implies that a heavy-tailed traffic flow is delay 
unstable. For a formal proof see Appendix 2. □ 

Since there is little we can do about the delay stability of heavy-tailed flows, we turn our 
attention to light-tailed traffic. The Pollaczek-Khinchine formula for the expected delay in a M/G/l 
queue implies that the intrinsic burstiness of light-tailed traffic is not sufficient to cause delay 
instability. However, scheduling in a queueing network couples the statistics of different traffic 
flows. We will see that this coupling can cause light-tailed flows to become delay unstable, giving 
rise to a form of propagation of delay instability. 
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3 Overview of Main Results 



In this section we introduce, informally and through simple examples, the main results of the paper 
and the basic intuition behind them. 

Let us start with the queueing system of Figure 1, which consists of two parallel queues and 
a single server. Traffic flow 1 is assumed to be heavy-tailed, whereas traffic flow 2 is light-tailed. 
Service is allocated according to the Max- Weight scheduling policy, which is equivalent to "Serve 
the Longest Queue" in this simple setting. Theorem 1 implies that traffic flow 1 is delay unstable. 
Our findings imply that traffic flow 2 is also delay unstable, even though it is light-tailed. 
The intuition behind this result is that queue 1 is occasionally very long (infinite, in steady-state 
expectation) because of its heavy-tailed arrivals. When this happens, and under the Max- Weight 
policy, queue 2 has to build up to a similar length in order to receive service. A very long queue 
then implies very large delays for the files of that queue under "First Come, First Served," which 
leads to delay instability. 

Heavy 



Light 




Figure 1: Delay instability in parallel queues with heavy-tailed traffic. 

Systems of parallel queues have been analyzed extensively in the literature. One of the main 
reasons is that their simple dynamics often lead to elegant analysis and clean results. However, real- 
world communication networks are much more complex. In this paper we go beyond parallel queues 
and analyze queueing networks with more complicated structure. A simple example is the queueing 
network of Figure 2, where traffic flow 1 is assumed to be heavy-tailed, whereas traffic flows 2 and 
3 are light-tailed. The server can serve either queue 1 alone, or queues 2 and 3 simultaneously. 
This example could represent a wireless network with interference constraints. In this setting the 
Max- Weight policy compares the length of queue 1 to the sum of the lengths of queues 2 and 3, 
and serves the "heavier" schedule. 
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Heavy 



Light 



Light 



Figure 2: Propagation of delay instability: conflicting with heavy-tailed traffic. 

The intuition from the previous example suggests that at least one of the queues 2 and 3 has 
to build up to the order of magnitude of queue 1, in order for these two queues to receive service. 
In other words, we expect that at least one of the traffic flows 2 and 3 will be delay unstable under 
Max- Weight. Our findings imply that, in fact, both traffic flows are delay unstable. The main 
idea behind this result is the following: with positive probability, the arrival processes to queues 
2 and 3 exhibit their "average" behavior. In that case, the corresponding queues build up slowly 
and together, which implies that when they claim the server they have both built up to the order 
of magnitude of queue 1. 

The simple networks of Figures 1 and 2 illustrate special cases of a general result: every light- 
tailed flow that conflicts with a heavy-tailed flow is delay unstable. For more details see Theorem 
2 in Section 4.1. 

Heavy 



Light 



Light 



Figure 3: Propagation of delay instability: concurring with heavy-tailed traffic. 

Going one step further, consider the queueing network of Figure 3. Traffic flow 1 is assumed to 
be heavy-tailed, whereas traffic flows 2 and 3 are light-tailed. The server can serve either queues 1 
and 2 simultaneously, or queue 3 alone. In this setting the Max- Weight policy compares the length 
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of queue 3 to the sum of the lengths of queues 1 and 2, and serves the "heavier" schedule. The 
intuition from the previous examples suggests that traffic flow 3 is delay unstable, but the real 
question is the delay stability of traffic flow 2. One would expect that this flow is delay stable: it is 
light-tailed itself, and is served together with a heavy-tailed flow, which should result in more service 
opportunities under Max- Weight. Surprisingly though, we show that there exist arrival rates 
within the stability region of this network, such that traffic flow 2 is delay unstable. 
The key observation here is that even though traffic flow 2 does not conflict with heavy-tailed traffic, 
it does conflict with traffic flow 3, which is delay unstable because it conflicts with heavy-tailed 
traffic. For more details see Propositions 1, 3, and 4 in Sections 4.2 and 4.3. 

The examples above suggest that in queueing networks with heavy-tailed traffic, delay instability 
not only appears but propagates through the network under the Max- Weight policy. Seeking 
a remedy to this situation, we turn to the more general Max-Weight-a scheduling policy. This 
policy assigns a positive a-parameter to each traffic flow, and instead of comparing the lengths of 
the queues/schedules, and serving the longest one, it compares the lengths of the queues to the 
respective a-powers. Our findings imply that in the network of Figure 1, we can guarantee that 
traffic flow 2 is delay stable, provided the a-parameter for traffic flow 1 is sufficiently 
small. In other words, we prevent the propagation of delay instability. This is a special case of a 
general result: if the a-parameters of the Max-Weight-a policy are chosen suitably, then the sum 
of the a-moments of the steady-state queue lengths is finite. For more details see Theorem 3 in 
Section 5.1. 



4 Max- Weight Scheduling 

In this section we evaluate the performance of the Max- Weight scheduling policy, with respect 
to the delay stability of traffic flows. Informally speaking, the "weight" of a feasible schedule is 
the sum of the lengths of all queues included in it. As its name suggests, the Max- Weight policy 
activates a feasible schedule with the maximum weight at any given time slot. More formally, under 
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the Max- Weight policy, the scheduling vector S(t) belongs to the set: 



F 

S(t) € arg max j £j Q f (t) ■ s/j . 



If this set includes multiple feasible schedules, then one of them is chosen uniformly at random. 
The following lemma states that the network is stable under the Max- Weight policy. Essentially, 



this result is well-known, e.g., for light-tailed traffic, see [24] ; for more general arrivals, see 23 . A 
subtle point is that in this paper we adopt a somewhat different definition for stability. So, we have 
to ensure that, apart from the sequences of queue lengths, the sequences of file delays converge as 
well. 

Lemma 2: (Stability under Max- Weight) The single-hop queueing network described in 
Section 2 is stable under the Max- Weight scheduling policy. 

Proof. Consider the single-hop queueing network of Section 2 under the Max- Weight scheduling 
policy. It can be verified that the sequence {Q(t); t E Z + } is a time-homogeneous, irreducible, 
and aperiodic Markov chain on the countable state-space Z+. Proposition 2 of [23 implies that 
this Markov chain is also positive recurrent. Hence, {Q(t); t 6 Z + } converges in distribution, 
and its limiting distribution does not depend on Q(0). Based on this, it can be verified that 
the sequence {D(k); k 6 N} is a (possibly delayed) aperiodic and positive recurrent regenerative 
process. Therefore, it also converges in distribution, and its limiting distribution does not depend 
on Q(0); see (22]. □ 



4.1 Conflicting with Heavy- Tailed Flows 

In this section we state one of the main results of the paper, which generalizes our observations from 
the simple networks of Figures 1 and 2. Before we give the result, though, let us define precisely 
the notion of conflict between traffic flows. 

Definition 6: The traffic flow / conflicts with /', and vice versa, if there exists no feasible 
schedule in S that includes both / and /'. 
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Theorem 2: (Conflicting with Heavy Tails) Consider the single-hop queueing network 
described in Section 2 under the Max- Weight scheduling policy. Every light-tailed flow that conflicts 
with a heavy-tailed flow is delay unstable. 

Proof. (Sketch) Let h and I be a heavy-tailed and a light-tailed traffic flow, respectively, and suppose 
that I conflicts with h. Queue h is occasionally very long (infinite, in steady-state expectation), 
due to the heavy-tailed nature of the traffic that it receives. In order for queue I to get served, the 
weight of at least one feasible schedule that includes I has to build up to the order of magnitude 
of queue h. However, with positive probability, the arrival processes of all feasible schedules that 
include I exhibit their "average" behavior. In that case, queue I builds up at a roughly constant 
rate, for a time period of the order of magnitude of queue 1. Combined with Lemma 1, this implies 
that traffic flow I is delay unstable. For a formal proof see Appendix 3. □ 

We emphasize the generality of this result. Namely, a light-tailed flow that conflicts with heavy- 
tailed traffic is delay unstable, irrespective of: i) its rate; ii) the tail asymptotics of its underlying 
distribution; iii) whether it is scheduled alone or with other traffic flows. Hence, we view Theorem 
2 as capturing a "universal phenomenon" for the propagation of delay instability. 

4.2 Concurring with Heavy-Tailed Flows 

So far we have shown that: i) a heavy-tailed traffic flow is delay unstable under any regenerative 
scheduling policy; and ii) a light-tailed traffic flow that conflicts with a heavy-tailed flow is delay 
unstable under the Max- Weight scheduling policy. It seems reasonable, however, that a light-tailed 
flow that does not conflict with heavy-tailed traffic should be delay stable. Unfortunately, this is 
not always the case. We demonstrate this by means of simple examples. 

Let us come back to the queueing network of Figure 3. The feasible schedules of this network 
are {1,2} and {3}, and all queues are served at unit rate, whenever the respective schedules are 
activated. The rate vector A = (Ai, A2, A3) is assumed admissible. The following proposition shows 
that traffic flow 2 is delay unstable if its rate is sufficiently high. 
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Proposition 1: (Concurring with Heavy Tails) Consider the single-hop queueing network 
of Figure 3 under the Max-Weight scheduling policy. If the arriving traffic is admissible and the 
rates satisfy A2 > (1 + Ai — A3)/2, then traffic flow 2 is delay unstable. 

Proof. (Sketch) Let us first give the intuition for the special case, where Ai = A3. Consider sample 
paths for which a very large file arrives to queue 1; this is a relatively likely event, since traffic flow 
1 is heavy-tailed. Queue 3 will build up to the order of magnitude of the large file in queue 1 in 
order to receive service. Starting from the time slot that the weights of the two schedules become 
equal, the Max- Weight policy will be draining the weights of the two schedules at the same rate. 
The period of time until they empty is of the order of magnitude of the large file in queue 1. Now 
assume that queue 2 stays small throughout this period. If the traffic flows 1 and 3 exhibit their 
"average" behavior, then each feasible schedule will be activated once every two time slots, since 
Ai = A3. However, if A2 > 1/2, queue 2 will build up to the order of magnitude of the large file in 
queue 1, which is a contradiction. 

The intuition for the more general case is based on the following "fluid argument": assume 
that the arrivals at each queue / £ {1,2,3} are a fluid with rate Xj. The departures from queue 
/ during periods when all queues are nonempty are also assumed to be a fluid with rate [Xf. The 
Max- Weight policy has the property of draining the weights of the two feasible schedules at the 
same rate. Hence, the departure rates are the solution to the following system of linear equations: 



Ai + A 2 - m - m = A3 - H3 
A*i + ^3 = 1 
Mi = £*2- 



The last two equations follow from the facts that Max- Weight is a work-conserving policy, and 
that queues 1 and 2 are served simultaneously. If the rate at which fluid arrives to queue 2 is 
greater than the rate at which it departs, i.e., 

. 1 + Ai + A 2 - A 3 

A 2 > M2 = , 
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or, equivalently, 

. ^ 1 + Ai - A 3 
A 2 > - , 

then queue 2 builds up over long periods of time, which, combined with Lemma 1, implies the 
delay instability of flow 2. A formal proof essentially shows that this fluid model is a faithful 
approximation of the actual stochastic system (with nonvanishing probability), whenever queue 1 
receives a large file; see Appendix 4. □ 

Proposition 1, as well as Propositions 3 and 4 of the next section, capture a "rate-dependent 
phenomenon" for the propagation of delay instability. 

We conjecture that a converse to Proposition 1 also holds; namely, that queue 2 is delay stable 
if the arriving traffic is admissible and A2 < (1 + Ai — As)/2. 

4.3 Practical Examples and Implications 

We illustrate the implications of the results presented so far in the context of specific network 
topologies, often used to model real-world communication networks. 

Example 1: (Parallel Queues) Consider the network of Figure 4, consisting of n parallel 
queues and a single server. Networks of parallel queues are often used to model wireless uplinks, 
downlinks, and call centers. Traffic flow 1 is assumed to be heavy-tailed, whereas the other traffic 
flows are light-tailed. The scheduling constraints of parallel queues require that no two queues can 
be served simultaneously. The server is allocated according to the Max- Weight scheduling policy, 
which in this setting is equivalent to "Serve the Longest Queue." 

Proposition 2: Consider the system of parallel queues depicted in Figure 4, under the Max- 
Weight scheduling policy. If traffic flow 1 is heavy-tailed, then all traffic flows are delay unstable. 

Proof. The result follows easily from Theorems 1 and 2. □ 

Example 2: (Input-Queued Switch) Consider the 2x2 input-queued switch depicted in 
Figure 5. Input-queued switches are often used to model internet routers. Traffic flow (1,1) is 
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Figure 4: Delay instability in parallel queues under Max- Weight scheduling: if traffic flow 1 is heavy 
tailed (black), then all traffic flows are delay unstable (gray.) 

assumed to be heavy-tailed, whereas all other flows are light-tailed. The scheduling constraints 
of an input-queued switch require that every feasible schedule has to be a matching between the 
sets of input and output ports. Thus, the feasible schedules of the network are {(1, 1), (2, 2)} and 
{(1, 2), (2, 1)}. In this setting the Max- Weight scheduling policy activates a matching with the 
maximum weight. 
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Figure 5: Delay instability in a data switch under Max- Weight scheduling: if traffic flow (1,1) is 
heavy tailed (black), then traffic flows (1,2) and (2,1) are delay unstable (gray.) Traffic flow (2,2) 
is also delay unstable, if its rate is sufficiently high. 

Proposition 3: Consider the 2x2 input-queued switch depicted in Figure 5, under the Max- 
Weight scheduling policy. If traffic flow (1,1) is heavy-tailed, then traffic flows (1,1), (1,2), and 
(2,1) are all delay unstable. If, additionally, A22 > (2 + An — A12 — A2i)/3, then traffic flow (2,2) is 
also delay unstable. 

Proof. The first part of the result follows from Theorems 1 and 2. Regarding the second part, we 
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provide the calculations for the associated fluid model, which justify the particular threshold for 
X22' assume that the arrivals at each queue / G {(1, 1), (1, 2), (2, 1), (2, 2)} are a fluid with rate A/. 
The departures from queue / during periods when all queues are nonempty are also assumed to be 
a fluid with rate /if. The Max- Weight policy has the property of draining the weights of the two 
feasible schedules at the same rate. Hence, the departure rates are the solution to the following 
system of linear equations: 

An + A22 — ^11 ~~ ^22 = A12 + A21 — ^12 — M21 
/"11 + fJ-12 = 1 
/"11 = M22 
^12 = /"21- 

The second equation is a consequence of the work-conserving nature of the Max- Weight policy. 
The last two equations follow from the facts that queue (1,1) is served simultaneously with queue 
(2,2), and queue (1,2) is served simultaneously with queue (2,1). If the rate at which fluid arrives 
to queue (2,2) is greater than the rate at which it departs, i.e., if 

2 + An + A22 — A12 — A21 
A22 > fJ-22 — ^ , 

or, equivalently, if 

2 + An — A12 — A21 
A22 > 3 , 

then queue (2,2) builds up over long periods of time, which, combined with Lemma 1, implies the 
delay instability of flow (2,2). The proof that the stochastic model follows the fluid model is similar 
to the proof of Proposition 1 and is omitted. □ 

Example 3: (Wireless Ring) Consider the wireless ring network of Figure 6. The network 
consists of 6 nodes, each of which receives traffic that it transmits to its neighboring node in the 
clockwise direction. Traffic flow 1 is assumed to be heavy-tailed, whereas all other flows are light- 
tailed. Due to wireless interference, if a link of the network is activated, then the links within 
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two-hop distance must be inactive; this is the so-called two-hop interference model. Thus, the 
feasible schedules of the network are {1,4}, {2, 5}, and {3, 6}. 



Figure 6: Delay instability in a wireless ring network under Max- Weight scheduling: if traffic flow 
1 is heavy tailed (black), then traffic flows 2, 3, 5, and 6 are delay unstable (gray.) Traffic flow 4 is 
also delay unstable, if its rate is sufficiently high. 

Proposition 4: Consider the wireless ring network depicted in Figure 6, under the Max- Weight 
scheduling policy. If traffic flow 1 is heavy-tailed, then traffic flows 1, 2, 3, 5, and 6 are all delay 
unstable. If, additionally, A4 > (2 + 2Ai — A2 — A3 — A5 — Ae)/4, then traffic flow 4 is also delay 
unstable. 

Proof. The first part of the result follows from Theorems 1 and 2. Regarding the second part, 
we provide the analysis of the associated fluid model: assume that the arrivals at each queue 
/ S {1,2,3,4,5,6} are a fluid with rate A/. The departures from queue / during periods when 
all queues are nonempty are also assumed to be a fluid with rate [if. The Max- Weight policy has 
the property of draining the weights of the three feasible schedules at the same rate. Hence, the 
departure rates are the solution to the following system of linear equations: 




Ai + A 4 - /ii - ^4 = A 2 + A 5 - 112 - /u 5 



Ai + A 4 - /ii - ^4 = A 3 + A 6 - fi 3 - fiQ 



/il + + = 1 



A*2 = M5 



A*3 = H6- 
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The third equation is a consequence of the work-conserving nature of the Max- Weight policy. 
The last three equations follow from the facts that queue 1 is served simultaneously with queue 4, 
and similarly for queues 2 and 5, and queues 3 and 6. If the rate at which fluid arrives to queue 4 
is greater than the rate at which it departs, i.e., if 

2 + 2Ai + 2A4 — A2 — A3 — A5 — A6 

A 4 > ^4 — , 

b 

or, equivalent ly, if 

2 + 2Ai — A2 — A3 — A5 — A6 
A 4 > ^ , 

then queue 4 builds up over long periods of time, which, combined with Lemma 1, implies the delay 
instability of flow 4. A detailed proof is omitted for brevity. □ 



5 Max-Weight-a Scheduling 

The results of the previous section suggest that Max- Weight scheduling performs poorly in the 
presence of heavy-tailed traffic. The reason is that by treating heavy-tailed and light-tailed flows 
equally, there are very long stretches of time during which heavy-tailed traffic dominates the service. 
This leads some light-tailed flows to experience very large delays and, eventually, to become delay 
unstable. Intuitively, by discriminating against heavy-tailed flows one should be able to improve the 
overall performance of the network, namely to mitigate the propagation of delay instability. One 
way to do this is by giving preemptive priority to the light-tailed flows. However, priority-based 
scheduling policies are undesirable because of fairness considerations, and also because they can be 
unstable in many network settings, e.g., see [l2|[T8] . 

Instead, we focus on the Max-Weight-a scheduling policy: given constants ctf > 0, for all 
/ G {1, . . . , F}, the scheduling vector S(t) belongs to the set: 

F 

S(t) G arg max j y^Q* f (t) ■ s f \. 
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If this set includes multiple feasible schedules, one of them is chosen uniformly at random. By 
choosing smaller values of the a-parameters for heavy-tailed flows and larger values for light-tailed 
flows, we give a form of partial priority to light-tailed traffic. 

5.1 The Main Result 

Let us start with a preview of the main result of this section: if the a-parameters of the Max- 
Weight-a policy are chosen such that E[A" f+1 (0)] < oo, for all / G {1, . . . , i 7 }, then the network 
is stable and the steady-state queue lengths satisfy: 

E[Q a /) <oo, Wfe{l,...,F}. 

An earlier work by Eryilmaz et al. has given a similar result for the case of parallel queues with 
a single server; see Theorem 1 of (6). In this paper we extend their result to a general single- hop 
network setting. Moreover, we provide an explicit upper bound to the sum of the a-moments of 
the steady-state queue lengths. Before we do that we need the following definition. 

Definition 7: (Covering Number of Feasible Schedules) The covering number k* of the 
set of feasible schedules is defined as the smallest number k for which there exist s , . . . ,s k G S 
with |J- =1 ^ = {1,...,F}. 

Notice that the quantity k* is a structural property of the queueing network, and is not related 
to the scheduling policy or the statistics of the arriving traffic: it is the minimum number of time 
slots required to serve at least one packet from each flow. 

Theorem 3: (Max-Weight-a Scheduling) Consider the single-hop queueing network de- 
scribed in Section 2 under the Max-Weight-a scheduling policy. Let the intensity of the arriving 
traffic be p < 1. If E[A a / + (0)] < co, for all / G {1, . . . ,F}, then the queueing network is stable 
and the steady-state queue lengths satisfy: 

F F 

Y.E[Q a /} < ^TH( P ,k*,a f ,E[A a / +1 (0)]), 
/=i /=i 
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where 



H 



(p,k*,a f ,E[A a / +1 (0)]) 



< 



' ^■(^ +1 (0)] + l), a f <l, 
(^Y f -K«f + ^.K, a f >l, 



and K = 2 a f- 1 ■ 



a f ■ 



(E[A a / +1 (0)] + l 



Proof. (Sketch) Consider the single-hop queueing network of Section 2 under the Max- Weight- a 
scheduling policy. It can be verified that the sequence {Q(t); t 6 Z + } is a time-homogeneous, 
irreducible, and aperiodic Markov chain on the countable state-space Z+. The fact that this 
Markov chain is also positive recurrent, and the related moment bound, are based on drift analysis 
of the Lyapunov function 



and use of the Foster-Lyapunov stability criterion. This implies that {Q(t); t G Z + } converges 
in distribution, and its limiting distribution does not depend on Q(0). Based on this, it can be 
verified that the sequence {D(k); k G N} is a (possibly delayed) aperiodic and positive recurrent 
regenerative process. Hence, it also converges in distribution, and its limiting distribution does not 



5.2 Traffic Burstiness and Delay Stability 

A first corollary of Theorem 3 relates to the delay stability of light-tailed flows. 

Corollary 1: (Delay Stability under Max-Weight-a) Consider the single- hop queueing 
network described in Section 2 under the Max-Weight-a scheduling policy. If the a-parameters 
of all light-tailed flows are equal to 1, and the a-parameters of heavy-tailed flows are sufficiently 
small, then all light-tailed flows are delay stable. 

Proof. With the particular choice of a-parameters, Theorem 3 guarantees that the expected steady- 
state queue length of all light-tailed flows is finite. Lemma 1 relates this result to delay stability. □ 




depend on Q(0). For a formal proof see Appendix 5. 



□ 



21 



Combining this with Theorem 1, we conclude that when its a-parameters are chosen suitably, 
the Max-Weight-a policy delay-stabilizes a traffic flow, whenever this is possible. 

Max-Weight-a turns out to perform well in terms of another criterion too. Theorem 3 implies 
that by choosing the a-parameters such that E[A°^ f+1 (0)] < oo, for all / € {1, ... , F}, the steady- 
state queue length moment E[Q^ f ] is finite, for all / G {1, ...,jF}. The following proposition 
suggests that this is the best we can do under any regenerative scheduling policy. 

Proposition 5: Consider the single-hop queueing network described in Section 2 under a 
regenerative scheduling policy. Then, 

E[A c +\0)] = oo E[Q C f] = oo, V/ € {1, ...,F}. 

Proof. This result is well-known in the context of a M/G/l queue, e.g., see Section 3.2 of [4]. It 
can be proved similarly to Theorem 1. □ 

Thus, when its a-parameters are chosen suitably, the Max-Weight-a policy guarantees 
the finiteness of the highest possible moments of steady-state queue lengths. 



5.3 Scaling Results under Light-Tailed Traffic 

Although this paper focuses on heavy-tailed traffic and its consequences, some implications of 
Theorem 3 are of general interest. In this section we assume that all traffic flows in the network 
are light-tailed, and analyze how the sum of the a-moments of steady-state queue lengths scales 
with traffic intensity and the size of the network. 

Corollary 2: (Scaling with Traffic Intensity) Let us fix a single-hop queueing network 
and constants a > 1 and B > 0. The Max-Weight-a scheduling policy is applied with a/ = a, 
for all / € {1, . . . ,F}. Assume that the traffic arriving to the network is admissible, and that the 
(a + l)-moments of all traffic flows are bounded from above by B. Then, 
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where M(k*,a, B) is a constant that depends only on k* , a, and B. Moreover, under any stabilizing 
scheduling policy 

/=i v HJ 

where M'{a) is a constant that depends only on a. 



Proof. If at = a > 1, for all / G {1, . . . , F}, then Theorem 3 implies that: 



M(k*,a,B) 



< 



where M{k* ,a,B) is a constant that depends only on k* , a, and £?. 



On the other hand, Theorem 2.1 of 21 implies that under any stabilizing scheduling policy 



there exists an absolute constant M, such that 



F 

M 



(1 - P) ' 



Utilizing Jensen's inequality, we have: 



F F 

/=i /=i 

F 



a 

> 

F° 



Consequently, there exists a constant M'(a) that depends only on a, such that 

under any stabilizing scheduling policy. □ 
Similar scaling results appear in queueing theory, mostly in the context of single-server queues, 



e.g., see Chapter 3 of 11 . More recently, results of this flavor have been shown for particular 
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queueing networks, such as input-queued switches 19,21]. All the related work, though, concerns 
the scaling of first moments. Corollary 2 gives the precise scaling of higher order steady-state 
queue length moments with traffic intensity, and shows that Max-Weight-a achieves the optimal 
scaling. 

We now turn our attention to the performance of the Max- Weight scheduling policy under 
Bernoulli traffic, i.e., when each of the arrival processes {Af(t); t G Z + } is an independent Bernoulli 
process with parameter Aj > 0. 

We denote by S max the maximum number of traffic flows that any feasible schedule s G S can 
serve. 

Corollary 3: (Scaling under Bernoulli Traffic) Consider the single-hop queueing network 
described in Section 2 under the Max- Weight scheduling policy. Assume that the traffic arriving 
to the network is Bernoulli, with traffic intensity p < 1. Then, 

F 

Y^E[Q f ]<2-k*-S max -{^). 
/=i 9 

Proof. If all traffic flows are light-tailed and all the a-parameters are equal to one, a more careful 
accounting in the proof of Theorem 3 provides the following tighter upper bound: 

F F 

Y,E[Q f \ < ^- • (S max + J>[4(0)]). 
/=i 9 /=i 

If the traffic arriving to the network is Bernoulli, then _E[^4j(0)] = A/, for all / G {1, . . . , F}. 
Moreover, the fact that the arriving traffic has intensity p, implies the existence of nonnegative real 
numbers £ s , for s G S, such that: 



A/<]TC s -s/, V/G{1,...,F}, 



and 

/=i 



24 



Consequently, 



F F 



j>[4(o)] = 5> 



/=i /=i 



<EE^- s / 



/=ises 



sG5 /=1 



/ Cs ' ^max 

se5 



and the result follows. 



□ 



Example 4: (n Parallel Queues) Consider a single-server system with n parallel queues. 
The arriving traffic is assumed to be Bernoulli, with traffic intensity p < 1. In this case k* = n 
and S'max = 1- Corollary 3 implies that under the Max- Weight scheduling policy, the sum of the 
steady-state queue lengths is bounded from above by: 



The total queue length of a system of parallel queues under a work-conserving scheduling policy 



context of parallel queues, the scaling provided by Corollary 3 is tight with respect to the traffic 
intensity, but not necessarily tight with respect to the size of the network. 

Example 5: (n x n Input-Queued Switch) Consider a n x n input-queued switch. The 
arriving traffic is assumed to be Bernoulli, with traffic intensity p < 1. In this case k* = n and 
•S'max = n. Corollary 3 implies that under the Max- Weight scheduling policy, the sum of the 




evolves like a Geo^/D/1 queue, from which we infer that X^=i ^[Qi] = ® 




So, in the 
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steady-state queue lengths is bounded from above by: 

n n a 2 

i=i i=i ^ 

In the context of input-queued switches, the joint scaling provided by Corollary 3, in terms of 
both the traffic intensity and the size of the network, is the tightest currently known. However, it 



should be noted that the correct scaling as n — > oo and p — > 1 is an open problem; see 19 . 

Example 6: (n x n Grid) Consider a single-hop queueing network in a n x n grid topology, 
under the one-hop interference model. The arriving traffic is assumed to be Bernoulli, with traffic 
intensity p < 1. In this case k* < 4 and S m£ix < n 2 /2. Corollary 3 implies that under the 
Max- Weight scheduling policy, the sum of the steady-state queue lengths is bounded from above 
by: 



i=l j=l 



8n 2 



6 Discussion 

The main conclusion of this paper is that the celebrated Max- Weight scheduling policy performs 
poorly in the presence of heavy-tailed traffic. More specifically, our findings show that the phe- 
nomenon of delay instability not only arises, but can propagate to a significant part of the network. 
This is somewhat surprising, since Max- Weight is known to perform very well in the presence of 
light-tailed traffic, at least in single-hop queueing networks. 

Another important conclusion is that the Max-Weight-a scheduling policy can be used to al- 
leviate the effects of heavy-tailed traffic, and is even order optimal, if its a-parameters are chosen 
suitably. However, for Max-Weight-a to perform well, accurate knowledge of the tail coefficients 
of all traffic flows is required. If the a-parameters are not chosen appropriately, then in light of 
Proposition 5, this policy may also perform poorly 

Of particular interest is the study of networks with time-varying channel state. In this class of 
models there exists an underlying state of the network which evolves in time, and the transmission 
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rates of the links are given by a function of the state. Under certain conditions on the channel 
state evolution, it can be verified that Theorems 1-3 carry over with minimal changes to this more 
general setting. 

An important direction for future research is to consider queueing networks with correlated 
traffic. The IID assumption that we made here facilitates the analysis and offers valuable insights, 
but is clearly restrictive. As alluded to earlier, evidence suggests that traffic in real-world networks 
exhibits strong correlations, and phenomena such as self-similarity and long-range dependence arise. 
Concrete results in this direction would be of great theoretical and practical interest. 
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Appendix 1 - Background Material 

1.1 BASTA, Little's Law, and Delay Stability 

In this section we give the "steady-state versions" of two important results in queueing theory, 
the Bernoulli Arrivals See Time Averages property and Little's Law, which we later use to prove 
Lemma 1. 

Consider the single- hop queueing network described in Section 2. Let Tf t k be the random time 
slot of the arrival of the k th file to queue f,keN, f G {1, . . . , F}. We assign two marks to this 
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file: i) the vector of queue lengths upon its arrival Q c ^\k) = (Qg(jf t k)\ 9 = 1, ■ • • , F); and ii) its 
end-to-end delay Df(k). 

Under a regenerative scheduling policy, and for a given / G {1,...,F}, the vector- valued 
sequences {Q c( - f) (k); k G N}, as well as the sequence {Q(t); t G Z + }, are (possibly delayed) 
aperiodic and positive recurrent regenerative processes. Therefore, they converge in distribution, 



and their limiting distributions do not depend on Q(0); see 22 . We denote by Q c<y ^ = (Qg^), g = 
1,...,F} and Q = (Q g ; g = 1,...,F) generic random vectors distributed according to these 
limiting distributions. 

The arrival of files at queue / constitutes a Bernoulli process with parameter Pf = P(Af(0) > 
0), / G {1, . . . , F}, since all arrival processes are IID. The Bernoulli Arrivals See Time Averages 
(BASTA) property relates the limiting distributions Q c ^ and Q. 

Theorem 4: (BASTA) Consider the single-hop queueing network described in Section 2 
under a regenerative scheduling policy. Then, 



Q c(f) =Q, V/G{1,...,F}, 



where = denotes equality in distribution. 



Proof. Fix a queue / G {!,..., F} and consider the random variables: 



T-l 



T 

i=0 



and 

K 



{Q(t)<B}, 



K ^ -{Q c(/) W<-B}' 

k=l 



where T,K G N, and B G ZK. The conditions of Theorem 3 in 14 are satisfied, and we have 



lim Vk = lim Ut w.p.l. 



Under a regenerative scheduling policy the sequences {l{Q( t )<^}; t G Z+} and {l/Qc(/)^<m; k G 
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N} are (possibly delayed) positive recurrent regenerative processes, which are also uniformly 
bounded by one. Then, the Ergodic theorem for regenerative processes implies that 



T-5-oo T->oo T 

t=0 



and 

K 



1 T_1 

lim U T = Jim - V l{Q(t)<B} = P(Q < B) w.p.l, 



Hm % = Hm 1 £ l {Q c(, )(fc) < B} = P(Q C ^) < 5) w.p.l; 
k=i 

see |22j. Consequently, 



P(Q <B) = P(Q C ^ < B), VB e Z%, 
and the result follows. □ 

Now let Lf(t) be the number of files in queue / at time slot t, either queued up or in service. 
Under a regenerative scheduling policy, the sequences {Lf(t); t E Z + } and {Df(k); k £ N}, f £ 
{!,..., F} are (possibly delayed) aperiodic and positive recurrent regenerative processes. Hence, 



they converge in distribution, and their limiting distributions do not depend on Q(0); see 22 . We 
denote by Lf and Df generic random variables distributed according to these limiting distributions. 
Little's Law relates the expected values of these limiting distributions. 

Theorem 5: (Little's Law) Consider the single-hop queueing network described in Section 
2 under a regenerative scheduling policy. Then, 



E[L f ]= Pr E[D f ], V/G{1,...,F}. 
Furthermore, this is true even if these expectations are infinite. 

Proof. First, we establish Little's Law for the case of finite expectations. Fix a queue / G {1, . . . , F}, 
and assume that E[Lf] is finite. We call the aggregate length of queue / during a regeneration 
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cycle, and write L J agg , the random variable 

n-1 

L l 99 = E L ^), 

t=T 

where tq and t\ represent the first two (or, in general, two consecutive) regeneration epochs of the 
network. 

Initially, we prove by contradiction that E[L[ gg ] is finite. Suppose that E[L[ gg ] is infinite. Using 
a truncation argument, similar to the one in Lemma 4 of Appendix 1.3, it can be shown that E[LA 
is also infinite. This contradicts our assumption that E[Lf] is finite. Hence, E[L agg ] is finite. 

The sequence {Lf(t); t 6 Z + } is a (possibly delayed) positive recurrent regenerative process. 
Combined with the fact that E[Ll gg ] is finite, the Ergodic theorem for regenerative processes implies 
that 

1 T_1 

^T^ Lf(t) = E[Lf] W ' P - 1; 
see (22] . Moreover, since the network is stable under a regenerative scheduling policy, 



Df(k) 

lim — = w.p.l; 

see Theorem 2b of [lOj. The sequence {Df(k); k G N} is also a (possibly delayed) positive recurrent 
regenerative process. Then, the Ergodic theorem for regenerative processes and Theorem 2e of |10| 
imply that 



1 K 

lim -^J2 D fW= E l D f} ^P" 1 ' 

A— >oo A ' — 



fc=l 

and 

S[L / ]=p/.^[Z>/]. 

To summarize, starting with the assumption that E[Lf] is finite, we showed that E[Lf] = 
Pf ■ E[Df]. The same can be shown if we start with the assumption E[Df] is finite, and work 
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similarly. Consequently, 

E[L f ] < oo E[D f ] < oo, 

which implies that Little's Law holds even if the implicated expectations are infinite. □ 

We now re-state and prove Lemma 1. 

Lemma 1: Consider the single- hop queueing network described in Section 2 under a regener- 
ative scheduling policy. Then, 

E[Qf] < oo E[D f ] < oo, V/ G {1, . . . , F}. 

Proof. Let us start with the implication 

E[Qf] < oo => £[-D/] < oo, V/ G {1, . . . , F}. 

Assume that E[Qf] is finite, for some / € {1, . . . , F}. Since every file has at least one packet, 

P(Q f (t) >B)> P(L f (t) > B), Vt G Z+, VB G Z + . 

We have argued that under a regenerative scheduling policy, the sequences {Qf(t); t G Z + } 
and {Lf(t); t G Z + } converge in distribution. So, taking the limit as t goes to infinity, we have: 

P(Qf > B) > P{Lf > B), MB G Z+, 

which, in turn, implies that 

E[Qf] > E[Lf]. 

Combining this inequality with Little's Law and the assumption that E[Qj] is finite, we conclude 
that 

E[D f ] < oo. 
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Let us now prove the implication 



E[Q f ] = oc ^ E[D f ] = 00, V/ G {1, . . . , F}. 

Assume that E[Qf] is infinite, / G {1, . . . , F}. The end-to-end delay of a file is bounded from below 
by the length of the respective queue upon its arrival, since the service discipline within each queue 
is "First Come, First Served." So, 

P{D f {k) > B) > P(Qf(T f:k ) > B), yk G N, V.B G Z+. 

We have argued that under a regenerative scheduling policy, the sequences {Df(k); k G N} 
and {Q/(rj ! fc); k G N} converge in distribution. So, taking the limit as k goes to infinity, we have 

P(D f > B) > P{Q c f if) > B), VB G Z + . 

Combining this with the BASTA property, 

P{D f > B) > P(Q f > B), yB G Z+, 

which results in 

E[D f ] > E[Q f ]. 
Finally, the assumption that E[Qf] is infinite implies that 

E[D f ] = 00. 



□ 
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1.2 "Average" Behavior of an IID Sequence 

The following result is a well-known corollary of the Strong Law of Large Numbers. We provide a 
proof for completeness. 

Lemma 3: Consider a sequence of IID random variables {B(t); t 6 N}, taking values in Z + , 
with finite rate A = E[B(l)] > 0. For any given e > 0, there exists a constant S > 0, such that 



By the strong law of large numbers, P(U m >iC m ) = 1. Because the sequence of events C m is 




T=l 



Proof. We define an event C m by 




r=l 



nondecreasing, the continuity property of probabilities implies that lim. 



-m— >oo 



P(C m ) = 1. Let us 



therefore fix some T such that P(Ct) > 1/2. 



Let us consider the event 



T 




T=l 



We choose 6 large enough so that P{D) > 1/2 and 8 > XT. Note that 




Note also that when both Ct and D occur, then 



t 



J2b(t) -Xt <et + S, Vt, 



T=l 



so that the latter event has positive probability, which is the desired result follows. 



□ 
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1.3 Truncated Rewards 

Consider the single-hop queueing network described in Section 2 under a regenerative scheduling 
policy. By definition, there exists a sequence of stopping times {r n ; n G Z + }, which constitutes a 
(possibly delayed) renewal process, i.e., the sequence {r n+ i — r n ; n G Z + } is IID. Moreover, the 
lattice distribution of cycle lengths has span equal to one and finite expectation. 

For t G Z + , let R(t) be an instantaneous reward on this renewal process, which is assumed 
to be an arbitrary function of Q(t). We define the truncated reward as R M (t) = min{R(t) , M} , 
where M is a positive integer. Under a regenerative scheduling policy, the sequences {R(t); t G 
Z + } and {R M (t); t G Z + } are (possibly delayed) aperiodic and positive recurrent regenerative 
processes. Consequently, they converge in distribution, and their limiting distributions do not 
depend on Q(0); see [22]. Let R and R M be generic random variables distributed according to 
these limiting distributions. We denote by R a gg the aggregate reward, i.e., the reward accumulated 
over a regeneration cycle. Similarly, R^gg represents the truncated aggregate reward. 

Lemma 4: Consider the single-hop queueing network described in Section 2 under a regener- 
ative scheduling policy. Suppose that there exists a random variable Y with infinite expectation, 
and a nondecreasing function /(•), such that limju^oo f(M) = oo, and 

(1) E[mm{Y,f{M)}]<E[R% g ]. 
Then, 

E[R] = oo. 

Proof. By definition, cycle lengths have finite expectation, and E[R^ gg ] is bounded from above by 
M ■ E[t\ — To]. Then, the Renewal Reward theorem implies that 

( 2 ) ^7T=r lim ^X> M (')> w.p.l; 

see Section 3.4 of (7|. The sequence {R M (t); t G Z + } is a (possibly delayed) positive recurrent 
regenerative process, which is also uniformly bounded by M. Then, the Ergodic theorem for 
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regenerative processes implies that 



^ T-i . T-l 

(3) lim - J^R M (t)= lim — min{ M} = S[min{i? ; M}], w.p.l; 

t=0 t=0 

see |22j. Eqs. (l)-(3) give: 

Mminly, / (M)}1 r 
1 J \ >U < E[mxn{R,M}}. 

E [T\ ~ T J 

By taking the limit as M goes to infinity on both sides, and using the Monotone Convergence 
theorem, we obtain 

ElY] <*[*]; 



E[ Tl - t ] 

see Section 5.3 of [26]. Finally, the fact that Y has infinite expectation implies that 

E[R] = oo. 



□ 



Appendix 2 - Proof of Theorem 1 

Consider a heavy-tailed traffic flow h G {1,...,F}. We will show that under any regenerative 
scheduling policy: 

E[Q h ] = oo. 

Combined with Lemma 1, this will imply that traffic flow h is delay unstable. 

Consider a fictitious queue, denoted by h, which has exactly the same arrivals and initial length 
as queue h, but is served at unit rate whenever nonempty. We denote by Qj.it) the length of 
queue h at time slot t. Since the arriving traffic is assumed admissible, the queue length process 
{Q~ h {t); t G Z + } converges to a limiting distribution Q~ h . 

An easy, inductive argument can show that under a regenerative scheduling policy, the length 
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of queue h dominates the length of queue h at all time slots. This implies that 



P(Q h (t) >B)> P{Q~ h {t) > B), 



Vt G Z 



Taking the limit as t goes to infinity, and using the fact that both queue length processes converge 
in distribution, we have: 



The time slots that initiate busy periods of queue h constitute regeneration epochs. Denote 
by Xi the length of the i th cycle. The random variables {Xf, i G N} are IID copies of some 
nonnegative random variable X, with finite first moment; this is because the length of queue h is 
a positive recurrent Markov chain, and the empty state is recurrent. 

We define an instantaneous reward on this renewal process: 



where M is some finite integer. 

Without loss of generality, assume that a busy period starts at time slot 0, and let B be the 
random size of the file that initiates it. Since queue h is served at unit rate, its length is at least 
B/2 packets over a time period of length at least B/2 time slots. This implies that the aggregate 
reward R^i„, i.e., the reward accumulated over a renewal period, is bounded from below by 



P(Q h >B)>P(Q- h >B), VB€Z + . 



In order to prove the desired result, it suffices to show that 



E[Q~ h ) = 



oo. 



R M (t) = mm{Q~ h (t),M}, 



Vt G Z. 
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Consequently, the expected aggregate reward is bounded from below by 



E[R™ g ] > £ min { ^, M 2 } • P(A h (0) = B) 

B=l 

= ^ min |_,M 2 }.P(A(0) = i3) 
= ii;[min{^ 0) ,M 2 }]. 



Then, Lemma 4 (see Appendix 1.3) applied to Y = (1/4)A|(0), implies that ^[QjJ = 00. This, in 
turn, gives: 

E[Q h ] = 00. 



Appendix 3 - Proof of Theorem 2 

Consider a heavy-tailed traffic flow h, and a light-tailed flow I that conflicts with h. We will show 
that for admissible traffic flow rates and under the Max- Weight scheduling policy: 

E[Qi\ = 00. 

Combined with Lemma 1, this will imply that traffic flow / is delay unstable. 

The time slots that initiate busy periods of the network constitute regeneration epochs. Denote 
by Xi the length of the i th cycle. The random variables {Xf, i G N} can be viewed as IID copies 
of some nonnegative random variable X, with finite first moment; this is because the network is 
stable under the Max- Weight policy and the empty state is recurrent. 

We define an instantaneous reward on this renewal process: 

R M (t)= min{ Qi(t),M}, Vt G Z+, 

where M is a positive integer. 

Without loss of generality, assume that a renewal period of the network starts at time slot 0. 
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Consider the set of sample paths where at time slot 0, queue h receives a file of size B packets, 
and all other queues receive no traffic; we denote this set of sample paths by H(B). Since the 
arrival processes of different traffic flows are mutually independent, P(H(B)) = P(Ah(0) = B) ■ 
^^-^(^(O) = 0)- For sample paths in H(B), denote by Tg the first time slot when the length 
of queue h becomes less than or equal to the sum of the lengths of all other queues: 



T B = min{t>o| ^2Q g (t) > Q h (t)} ■ l HiB) . 



9+h 

Under the Max- Weight scheduling policy, queue I receives no service until time slot Tg. Moreover, 
queue h is served at unit rate. So, for sample paths in H(B), 

B-(T B -1)< Q h (T B ) < E Q 9 (Tb) = E E A S)- 

g^h g^h t=l 

A direct consequence of the Strong Law of Large Numbers is the existence of positive constants 
e and S, such that the set of sample paths: 

t 

A = {|EA^)-A ff | <e-t + 5, VtGiV, V 5 //i}, 

T=l 

has positive probability (see Lemma 3 in Appendix 1.2.) We denote by H(B) the set of sample 
paths A n H(B). Due to the IID nature of the arriving traffic, P(H(B)) = P(A) • P{H{B)). For 
sample paths in H(B), we have: 

t b -i> a-C-i)-' 



E 9 ^(A s + f) + l 
Moreover, 

T B -1 

Q^Tb) = E Mt) > (A, - e) ■ (Tg - 1) - 8. 

t=i 

Consequently, for sample paths in H(B) there exist positive constants c and Bq, such that: 

Qi(T B ) > cB, VB > B . 
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Since at most one packet from queue I can be served at each time slot, the length of queue I is 
at least cB/2 over a time period of length at least cB/2 time slots. This implies that the aggregate 
reward R^ QQ , i.e., the reward accumulated over a renewal period, satisfies the lower bound 



R agg " 1 {B>B Q } ■ 1h(b) > min { ( < y) ■ 1 {B>B }, M 2 } ■ 1 6(B) . 
Then, the expected aggregate reward satisfies 

oo 

E [ R agg\ > Yl E ^99 ' 1 {B>B } ' 1 H(B)] 
B=l 

> P(A) • [J P(M0) = 0) • E min { (V) • 1 {B>B Q) ,M 2 } ■ P(A h (0) = B). 
g+h B=l 

So, there exists a positive constant d ', such that 

EKg] > c> ^[min { (^) 2 • l {Ah{0) >_B 0} ,M>}} . 

Finally, Lemma 4 (see Appendix 1.3) applied to Y = (l/A)c 2 A 2 i (0) ■ l{A h (o)>B }' i m P nes that 
E[Qi] = 00. 

Appendix 4 - Proof of Proposition 1 

Consider the single-hop queueing network of Figure 3 under the Max- Weight scheduling policy. 
Assume that traffic flow 1 is heavy-tailed, traffic flows 2 and 3 are light-tailed, and also that 
A 2 > (1 + Ai - A 3 )/2. We will show that 

E[Q 2 ] = 00. 

Combined with Lemma 1, this will imply the delay instability of queue 2. 

Our proof is based on renewal theory, using a strategy similar to the one in the proof of Theorem 
2. The time slots that initiate busy periods of the network constitute regeneration epochs. Denote 
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by Xi the length of the i th cycle. The random variables {Xi; i G N} can be viewed as IID copies 
of some nonnegative random variable X, with finite first moment; this is because the network is 
stable under the Max- Weight policy and the empty state is recurrent. 
We define an instantaneous reward on this renewal process: 

R M (t) =mm{Q 2 (t),M}, t € Z + , 

where M is a positive integer. 

Without loss of generality, assume that a renewal period of the system starts at time slot 0. 
Consider the set of sample paths of the network, where at time slot 0, queue 1 receives a file of 
size B packets, and all other queues receive no traffic; we denote this set of sample paths by H(B). 
Clearly, the event H{B) has positive probability, as long as B is in the support of Al(0), which we 
henceforth assume: 

P(H{B)) = P(Ai(0) = B) ■ P(A 2 (0) = 0) • P{A 3 (0) = 0). 

Our proof strategy is as follows: initially, queue 3 does not receive service under Max- Weight, 
so it starts building up. At the time slot when the service switches from schedule {1,2} to schedule 
{3}, and if the arrival processes of all traffic flows exhibit their "average" behavior, queues 1 and 3 
are proportional to B, whereas queue 2 remains small. Then, Max- Weight will start draining the 
weights of the two feasible schedules at roughly the same rate, until one of them empties. Let [if 
denote the departure rate from queue / during this period. Roughly speaking, the departure rates 
are the solution to the following system of linear equations: 



Ai + A 2 - m - fi2 = A 3 - fj, 3 

Ml + M3 = 1 

Ml = M2- 



The last two equations follow from the facts that Max- Weight is a work-conserving policy, and that 
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queues 1 and 2 are served simultaneously. If the rate at which traffic arrives to queue 2 is greater 
than the rate at which it departs from it, i.e., 

. I + Ai + A 2 - A 3 

A 2 > = jj , 

or, equivalently, 

. I + Ai - A 3 

A 2 > 2 , 

then queue 2 builds up during this time period, which is proportional to B. This implies that 
E[Q2\ = oo, since B is heavy-tailed distributed. 

Throughout the proof we use the following shorthand notation: we say that a random variable 
X scales at least linearly with B on the event H, and write X = Qh(B), if there exist positive 
constants k and k' (possibly depending on the event H), such that X > k • B — k' , for all sample 
paths in H. 

We break the proof into four steps. 

Step 1 

For sample paths in H(B), denote by T B the first time slot, starting from 0, when the length 
of queue 3 becomes greater than or equal to the sum of the lengths of queues 1 and 2: 

T l B = min{t > | Q 3 (t) > Qi(t) + Q 2 (t)} ■ l H{B y 

The first part of the proof is to show that Qi{Tg) and Q 3 (Tg) scale at least linearly with B, 
provided all arrival processes exhibit their "average" behavior. 

Under the Max- Weight scheduling policy, queue 3 receives no service until time-slot Tg. More- 
over, the server of the system has unit service rate. So, for sample paths in H{B): 

Qi(Th) < Qi{Th) +Q 2 (Tjj) < Q 3 (TA). 
A direct consequence of the Strong Law of Large Numbers is the existence of positive constants 5 
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and e, such that the set of sample paths: 

t 

A(B) = [(\ f -e)t-6<Y, M T ) < (A/ + e)t + <5, Vt € {1, . . . , - 1}, V/ G {1, 2, 3}}, 



T = l 



has probability bounded away from 0, uniformly over all B (see Lemma 3 in Appendix 1.2.) Note 
that e can be chosen arbitrarily small. Similarly, 

t 

A = {(X f -e)t-5<J2 M-r) < (A/ + e)t + 5, Vt G N , V/ G {1, 2, 3}}, 

T=l 

has also probability bounded away from 0. Denote by H(B) the set of sample paths H(B) n A(.B), 
and observe that H{B) n A(B) D H{B) n A. Then, the IID nature of the arriving traffic implies: 

P{H(B)) = P(H(B) n A(B)) > P{H{B) n A) = P{H(B)) • P(A) > 0. 

For sample paths in H(B), we have: 

Qi(Tb) >B-(T b -1) + (Ai - e) • (T£ - 1) - <5. 

Moreover, 



Qs(rA) = ^ < (A 3 + e) • (Tg - 1) + ,5. 

t=i 

Consequently, since Q\{Tq) < Qz{T B ), we obtain: 

(4) TA-1> ^ . 

lJ — 1 + A3 — Ai + 2e 

Therefore, 



T 1 —i 



Qa(TA) = £ A 3 (t) > (A 3 - e) • (Tg - 1) - S, 



t=i 



>-^-*- 1+x B 3 :iU -s- 



44 



which implies that Qz{T B ) = ftjj^(B). 

Coming to queue 2, it can be verified that for sample paths in H(B) and for any subinterval 
{r ,...,ri} of {1,...,T B }: 

Tl-l 

J]A 2 (*)< (A 2 + 2e) • (n - r ) + 2<J. 

t=T0 

If e is chosen sufficiently small, such that A2 + 2e < 1, then 



(5) Q 2 {T l B ) < A 2 (T 1 B -l) + 25<\ 2 + 2e{T l B - 1) + 46, 

since queue 2 gets served whenever it is nonempty throughout the period {1, . . . ,T B — 1}. This 
shows that, essentially, Q 2 {T B ) does not scale with B. 

We finally develop a lower bound on Qi(T B ). By definition, 

(6) Q 3 (Th - 1) < Qi(T B - 1) + Q 2 (T B - 1). 
By arguing similarly to Eq. (5), it can be verified that 

(7) Q 2 {T B -l) < A 2 + 2e(Tij - 2) + 45. 

Eq. (6) and (7), combined with the fact that queue 1 is served at each time slot until T B , imply: 

(8) Qs(T B - 1) < B - (T B - 2) + (Ai + 3e) • (T B - 2) + 55 2 + A 2 . 
Moreover, for sample paths in H(B) 

(9) Q3 (T ^ _ 1) > (As _ e ) . ( T i -2) -6. 
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Eq. (8) and (9) give: 



Tb ~ 1< l + A 3 -A 1 -4 £ +1 ' 



which, combined with Eq. (4), results in: 

Qi(Tk) >B-(Th-l) + (A, - e) ■ (Th - 1) - * 
>B __B + M + A V _ 1 
1 + A 3 - Ai - 4e 

+ (^>- 1 + A3 _ Al + 2f -*- 

It follows that Qi(Tg) = Qjj^(B), provided e is chosen sufficiently small. 

To summarize: at time slot Tg, queues 1 and 3 are proportional to B, while queue 2 has 
remained small. 

Step 2 

Now denote by the first time slot after T B , that either queue 1 or queue 3 becomes empty: 

T% = min{t > T\ \ Q 1 (t) ■ Q 3 (t) = 0} • 1^ (B) . 

The second part of the proof is to show that if the arrival processes exhibit their "average" behavior, 
then at time slot T|, the length of queue 3 is, roughly speaking, no larger than the sum of the 
lengths of queues 1 and 2. 

For the same constants 5 and e defined in Step 1, the set of sample paths: 

t 

A'(B) = [(X f -e)t-S< A f (r)<(X f + e)t + S, Vt G {T B , . . . , T 2 B - 1}, V/€ {1,2,3}}, 



T 1 B 



has probability bounded away from 0. We denote by H{B) the set of sample paths H(B) n A'(B). 
Due to the IID nature of the arriving traffic: 

P{H{B)) > P{H{B)) ■ P(A) 2 > 0. 
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We will show that for sample paths in H(B): 



(10) Q 3 (T%) < Qi(T 2 B ) + Q 2 {T 2 B ) + 2e(T 2 - T B ) + 25 + 3. 

First, notice that queues 1 and 3 cannot empty at the same time slot, since they cannot be 
served simultaneously Therefore, we have two possible cases: if Q 3 {T B ) = 0, then Eq. (10) is 
trivially satisfied. Otherwise, suppose that Qi{T%) = 0. Then, Si(Tj - 1) = S 2 {T% - 1) = 1, while 
S 3 (T B - 1) = 0. For sample paths in H(B) we have: 

Q 3 (T 2 ) = Q 3 (T 2 - 1) + A 3 (T 2 - 1) 

(11) < Q 3 (Tl - 1) + A 3 + 2e-(T 2 B -T l B ) + 26. 

Moreover, under the Max- Weight policy: 

(12) Qz(T 2 B - 1) < Qi(T B - 1) + Q 2 (T 2 - 1). 
Finally, 

Q^T 2 - 1) + Q 2 (T 2 - 1) - 2 < Qi{T B ) + Q 2 (T 2 ), 

which, in turn, gives: 

(13) Q 1 (T 2 -l) + Q 2 (T 2 -l) + 2e-(T 2 -T 1 B ) + 25 + l < Q l (T 2 ) + Q 2 (T 2 ) + 2e-(T 2 -T 1 B ) + 25 + 3. 

Since A 3 < 1, Eq. (11)-(13) imply that Eq. (10) holds. 
Step 3 

The third part of the proof uses the results of Steps 1 and 2 in order to show that, for the 
sample paths of interest and if A2 > (1 + Ai — X 3 )/2, then Q 2 {T B ) = 0,^^(13). 
By definition, 

Qs(Th) >Qi(T 1 B ) + Q2(Th)- 
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By substituting the two sides of Eq. (10), we get: 

(14) Q 3 (T B ) - Q 3 (T l B ) < Qx(Tl) - Qi{T B ) + Q 2 (T 2 B ) - Q 2 (T l B ) + 2e(T 2 B - T B ) + 25 + 3. 

For sample paths in H{B) define the random variables: 

r|-i 

^f=( w ^ T - £ S f (t))-l m , fe {1,2,3}, 

which are the average service rates to each queue during the interval {T B , . . . , T B — 1}. Notice that 

(15) Mi = M2, 
and also 

(16) /il+^ 3 = l. 

Since both queues 1 and 3 are nonempty during the inerval {T B , . . . , T| — 1}, we have: 

(17) Qi(T%) - Qi{T B ) < (Ai + e - /xi) • (Ti - ) + <5, 

(18) Q 3 (Tl) - Q 3 (T£) > (As - e - /i 3 ) ■ (^ - Tg) - 5. 

Eqs. (14), (17), and (18) imply: 
(A3 - e - M3 ) • (Tl - ) - 5 < (Ai + e - W ) • (T| - 7* ) + 5 + Q 2 {T 2 B ) - Q 2 (T B ) + 2e(T 2 - T B ) + 25 + 3, 
Using Eq. (16) and collecting terms: 

• tn - Th) > - C + Ai - Aa + 4g ) • ( ti - Th) + 9m - Q^b) _ g + 3 

/ l + A 1 -A 3 + 4e x 2 x Q 2 {Tp A5 + 3 
> g J ' {Tb " Ts) 2 2~ • 
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Then, for sample paths in H(B), the queue length Q2(Tg) is bounded from below by: 

QiP%) > (M - t - fi) ■ {1% -TD-6 

>( A2 _I±4^_ 3£ ).(T|-TA)-^-^. 
In the first inequality we have also used Eq. (15). Therefore, 

Q 2 (Ti) > \- (A 2 - 1 + ^" A3 - 3e) ■ (Ti - Th) -25-1. 

If A2 > (1 + Ai — Aa)/2, the constant e can be chosen sufficiently small, so that: 

1 + Ai - A 3 ^ n 

A2 3e > 0. 

A final observation is that the duration of the interval {T^, . . . , T| — 1} is bounded from below 
by min{Qi(T^), Qs{T^)}, because both queues are served at unit rate. So, 

Consequently, 

(19) Q2p%) = n m {B). 

Step 4 

In Step 3 we showed that for sample paths in H(B), queue 2 builds up to the order of B. In the 
fourth and final step of the proof, we show that this implies that the expected steady-state length 
of queue 2 is infinite. 

Eq. (19) implies that for sample paths in H(B), there exist positive constants c and Bo, such 
that: 

Q 2 (Tl) > cB, VS > B . 
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Since at most one packet from queue 2 can be served at each time slot, the length of queue 2 is 
at least cB/2 packets over a time period of length at least cB/2 time slots. Hence, the aggregate 
reward R^ QQ , i.e., the reward accumulated over a renewal period, satisfies the lower bound 



R agg ' 1 {B>B } ■ ^h(B) ^ min { (^) ' 1 {B>B },M 2 ^ ■ 

Then, the expected aggregate reward is bounded by 

oo 

E [ R agg] > Yl E ^ R ^99 ' 1 {B>B i) } ' lff( B )] 
B=l 

> P(A) 2 ■ P(A 2 (0) = 0) • P(A 3 (0) = 0) 



E min {(V) " 1 {b>b },M 2 } ■ P(A 1 (0) = B) 

B=l 



So, there exists a positive constant c', such that 

E[B% g ] > c> • i?[min{(^) 2 • l {Mo) >s o} , M 2 } 

Finally, Lemma 4 (see Appendix 1.3) applied to Y = (l/4)c 2 A 2 (0) • 1{Ai(o)>b }' i m P nes that 
E[Q 2 ] = oo. 



Appendix 5 - Proof of Theorem 3 

Consider a set of feasible schedules {a k ; k = 1, . . . , k*} such that: 

fc* 

{Ja k = {l,...,F}. 
k=l 

(The admissibility of the arriving traffic implies that such a set of feasible schedules exists.) 
By the definition of the intensity parameter p £ (0, 1), there exist nonnegative numbers i 
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1, . . . , I, adding up to 1, and feasible schedules s l , i = 1, . . . , I, such that: 



i=l 



Notice that 

fc* 



(i-p)-£i-^+p-Ec^)eA 



A;* 

fe=l i=l 

where A denotes the closure of the set A. This is because we have a convex combination of (J + k*) 
feasible schedules, and the stability region is known to be a convex set; see Section 3.2 of [9j. 
Moreover, 

fe=l k=l 

where If denotes the F-dimensional vector of ones. 

A well-known monotonicity property of the stability region is the following: if < A' < A" 
componentwise, and A" 6 A, then A' £ A. Using this property, we have: 

(^•l, + A) 6 A. 

This, in turn, implies the existence of nonnegative numbers Oj, j = 1, • • ■ , J, adding up to 1, and 
of feasible schedules s- 7 = (s^), j ' = 1, • • • , J, such that: 

(20) x f <j2<>r4-^r> V/G {!,..., F}. 

3=1 

Under the Max-Weight-a scheduling policy the sequence {Q(t); t £ Z + } is a time- homogeneous, 
irreducible, and aperiodic Markov chain on the countable state-space . We will prove that this 
Markov chain is also positive recurrent, and we will establish upper bounds for the a-moments of 
the steady-state queue lengths, provided that E[A°^ t+1 (0)] < oo, for all /€{!,... , F}. 
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Consider the Lyapunov function 



^-^ at + 1 1 

f =i J 



We have 



E[V(Q(t + l)) | Q(t)] = j2E[-^—(Q f (t) + A f (t)rf+ l | Q(t) 

f=i f i " 

where 

A f (t) = A f (t)-Sf(t)-l {Qf{t>0} . 
Throughout the proof we use the shorthand notation 

Vf(Qf(t)) = ^ ri Q7 + \t). 

We consider the conditional expectation of the terms Vf(Qf(t + 1)), distinguishing between two 
cases. 

i) af < 1: Consider the zeroth order Taylor expansion around Qf(t) (i.e., the mean value 
theorem): 

^(QAt) + A f (t)) a f +i = ^tq; /+1 w + A,(f) • atr, 

for some £(t) € [Q,(t) - S>(t) • l {Qf(t)>0} ,Q f (t) + Thus, 

V f (Qf(t + 1)) = Vf(Q f (t)) + A f (t) ■ m af , 

and 

E[V f (Qf(t + 1)) | Q(t)] = Vf(Q f (t)) + E[A f (t) • £(t)«/ I Q(*)]. 
Consider the event Tf(i) = {Af(t) < 0} and its complement. We have: 

E[V f (Q f (t + 1)) | Q(t)} < V f {Q f (t)) + E[A f (t) • (Q f (t) + ^(t))"' • l {r c {t)} | Q(t)] 
(21) + E[A f (t) • (Q 7 (i) - • l {Q/ (t)>o}) a ' • l { r /W } I <?(*)]■ 
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Since Qf(t), Qf(t) — Sj(t) • l{Q f (t)>o}i an d Af(t) are nonnegative numbers and aj G (0, 1], it can 
be verified that 

(22) (Q f (t) + A f (t)rf <Q a /(t) + A a /(t). 
Moreover, since they are also integers, 

(23) (Q f (t) - S f (t) • l W/W >o}) a/ > Q a /(t) ~ S f (t) • l W/W >o } - 
Eqs. (21)-(23) imply that 

E[V f (Q f (t + 1)) | Q(t)} < V f (Q f (t)) + E[A f (t) | Q(t)} ■ Q a / (t) 

+ E[A f (t)-A a /(t)-l {T c m \Q(t)} 
+ E[-A f (t) ■ S f (t) ■ l {Qfi t)>o} ■ l{r /( t)} I Q(t)}- 

If Af(t) < 0, which is denoted by the event then -A f (t) < 1. Also, if A f (t) > 0, which is 

denoted by the event r° f (t), then A f (t) < A f (t), so that A f (t) ■ A a f f (t) < A a f f+1 {t). Consequently, 

E[V f (Q f (t + 1)) | Q(t)} < V f (Q f (t)) + E[A f (t) \ Q{t)\ ■ Q a / (t) + E[A a / +l (t) • l {r c (t)} | Q(t)\ + 1. 

Finally, the fact that the random variables {Af(t); t £ Z + } are IID gives: 

E[V f (Q f (t + 1)) | Q(t)} < V f (Q f (t)) + E[A f (t) \ Q(t)} ■ Q a / (t) + E[A a / +1 (0)] + 1. 

The inequality above implies that 

(24) E[V f (Q f (t+l)) | Q(t)] < V f (Q f (t))+E[A f (t) \ Q( t )].Qy (1)+^^/ (t)+E[A a / +1 (0)]+l. 
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ii) ctf > 1: Consider the first order Taylor expansion around Qf(t): 

1 1 A 2 At) 

— — (G.(t\ + AJtX) a f +1 = — — O^tW+' + A^fl.Ol'/iU 



-(Q,(t) + A / (t))"/+ 1 = — ± —Q f (trf +1 + A f (t) ■ Q a /(t) + -tp--a r m af - L 

1 Ctf + 1 J Z 



for some £(t) € [Q f (t) - S f (t) • l {Q/(t )>o}, Qf{t) + A f {t)\. Then, 



A){t) 



(26) e[-J±± • a f ■ m*'- 1 Q(t) 



< E 



■afiQfW + AfWrf- 1 Q(t) 



(25) E[Vf(Q f (t+l)) | Q(t)] =V f (Q f (t))+E[A f (t)\Q(t)]-Q a /(t)+E -^.^^(t) /" 1 Q(t) 



Since A^(i) • q/ > and a/ — 1 > 0, the last term can be bounded from above by 



Moreover, it is easy to verify that for ctf > 1, 



(27) 



(Q f (t) + A f (t)r^ < 2"/- 1 • (Q a /-\t) + A a /-\t)), 



and also that 



(28) 



A}(t) < A){t) + 1. 



Eqs. (26)-(28) imply that 



E 



2 



(29) 



Q(t)] < 2-/" 2 • a/ • (i?[Aj(*)] + l) • Q^ _1 (t) 

+ 2^.a r {E[A a / + \t)] + E[A a /~\t)]) 
<K-Q a /~\t) + K, 
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where K = 2 a f~ 1 ■ a f ■ (E[A°f f+1 (0)] + l). Then, Eqs. (25) and (29) imply that 



E[V f (Q f (t + 1)) | Q{t)\ < V f (Q f (t)) + E[A f (t) \ Q(t)] • Q a /(t) + K • Q a / \t) + K 

= V f {Q f (t)) + E[A f (t) | Q(t)} • Q a /(t) + ^ • Q a /(t) 

2k* 



(30) +(K.Q a /-\t)- l -^.Q a /(t)+K). 



Our goal is to bound from above the last term of the right-hand side of Eq. (30). Relaxing the 
constraint that Qf(t) has to be an integer, we have: 

(31) K ■ Q a /~\t) -^.Q a /( t )+K< max [k ■ a;"'" 1 - ^ • x a f + k), Vt G Z+. 

It can be verified that the optimization problem in the right-hand side has the unique solution 
x * _ . -j^j-- Therefore, the optimal value is 

(32) K°< (^-Y'- 1 • (a '-T" + A' < Jf / . f^)"'" + K. 

\l-pJ a f f \l-pJ 

Eqs. (31) and (32) imply that 

(33) K ■ Q a / \t) -^.Q a /(t) + K< K a f ■ (— ) + K, Vt G Z+. 

Then, Eqs. (30) and (33) give: 
(34) 

E[V f (Q f (t+l)) | Q(t)} = Vf{Qf(t))+E[A f (t) \ Q(t)]-Q a / \t)+^-Cf/ ' (t)+K a f {^-^ +K. 



Summarizing our findings from cases (i) and (ii), Eqs. (24) and (34) imply that 
E[V f (Q f (t + 1)) | Q(t)\ < Vf(Qf{t)) + E[A f (t) \ Q(t)] ■ Q a / (t) 
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for all / G {1, ... , F} , where 



H(p,k*,a f ,E[A a / +1 (0)]) = < 



E[A a / +1 (0)] + l, 

' 2k* X 



A" ■ ['^VT' * + a/ > 1, 



and if = 2 a f~ 1 ■ a f ■ (E[A a f f+1 (0)] + l). Summing over all / G {1, . . . ,F}, gives: 



E[V(Q(t + 1)) | Q(t)\ < V(Q(t)) + ^2(X f - S f (t) ■ l {Q/W >o } ) • 

/=i 

+ • E + E^O*> a /' ^? /+1 (o)] 



Taking into account Eq. (20), we have: 



E[K(Q(t + 1)) | Q(t)] < V(Q(t)) -LjP.J2Q a / (t) + fc* , «/, ^[^ /+1 (0)] 



/=i 



F J 



/=i j=i 

By the definition of the Max-Weight-a scheduling policy, the last term is nonpositive. So, 



E[v(Q(t + 1)) i Q(t)) < vm))- ^•E^/ / w+E F (^ r ' a /'^?' +1 (°)])- 



2A; 



Then, the Foster-Lyapunov stability criterion and moment bound (e.g., see Corollary 2.1.5 of 
implies that the sequence {Q(t); t £ Z + } converges in distribution. Moreover, its limiting distri- 
bution (Qf, f = 1, . . . , F) does not depend on Q(0), and satisfies 



/=i 



Based on this, it can be verified that the sequence {D(k); k £ N} is a (possibly delayed) aperiodic 
and positive recurrent regenerative process. Hence, it also converges in distribution, and its limiting 
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distribution does not depend on Q(0); see [22] . 
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